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power,  increase  the  likelihood  that  procedures  will  be  remembered  or  can  be 
regenerated,  and  enable  the  transfer  of  skills. 
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MARY  S.  RILEY 


My  goal  in  this  chapter  is  to  explore  how  much  understanding  a  user  needs  to  perform  skill¬ 
fully.  My  interest  in  the  relationship  between  understanding  and  skilled  performance  is 
currently  focused  on  two  areas:  basic  electronics  and  human-computer  interfaces. 

In  the  study  of  how  people  learn  basic  electronics,  I  am  analyzing  how  theoretical  under¬ 
standing  of  physics  might  influence  skilled  performance  in  analyzing  and  troubleshooting  elec¬ 
tronic  circuits.  A  traditional  assumption  is  that  formal  physics  is  necessary  for  skilled  task  per¬ 
formance.  Yet  many  skilled  electronics  technicians  probably  do  not  use  formal  physics  to  per¬ 
form  these  tasks,  and  some  may  have  had  no  formal  training  at  all.  However,  the  issue  is  com¬ 
plicated.  Electronic  technicians  spend  years  of  apprenticeship  and  practice.  Perfaaqps  knowledge 
of  formal  physics  provides  a  more  direct  way  to  develop  understanding  early  in  learning.  Just 
because  formal  physics  may  not  show  up  explicitly  in  skilled  performance  does  not  mean  it 
would  not  facilitate  learning. 

My  interest  in  human-computer  interactions  focuses  on  how  much  understanding  is  required 
to  become  a  skilled  user.  Clearly,  understanding  must  be  defined  relative  to  the  task  or  set  of 
tasks  the  user  wants  to  perform.  Someone  who  is  using  a  text  editor  to  write  a  paper  needs  to 
understand  commands  at  a  very  different  level  than  someone  who  intends  to  modify  the  editor. 
To  the  person  who  uses  the  editor  only  in  order  to  write  a  paper,  a  detailed  understanding  of 
the  principles  of  systems  design  would  probably  have  little  beneficial  effect;  it  may  even  be 
harmful  if  the  ideas  distracted  the  user. 

We  must  also  consider  tasks  other  than  the  immediate  ones  the  user  will  perform:  users  also 
do  experiments;  they  make  mistakes,  at  times  the  system  fails.  For  a  user  to  be  able  to  inter¬ 
pret  the  effects  of  an  experiment  or  the  nature  of  a  mistake  requires  additional  understanding. 
Even  more  understanding  is  required  to  distinguish  between  the  behavior  of  a  functioning  sys¬ 
tem  and  a  nonfunctioning  system.  Furthermore,  with  the  increasing  proliferation  of  computers, 
most  users  need  to  learn  several  systems.  We  must  be  concerned  with  identifying  the  kinds  of 
understanding  a  user  needs  to  transfer  skills  between  systems. 

In  the  next  two  sections  I  focus  on  a  framework  for  characterizing  user  understanding  and 
discuss  the  role  of  understanding  in  performance  and  learning.  I  propose  that  (a)  the  level  at 
which  a  user  interacts  with  a  device  is  determined  by  the  tasks  being  performed;  (b)  the  func¬ 
tions  and  structures  that  ate  undentood  differ  from  level  to  level  (see  Miyake,  in  press);  (c)  a 
uniform  set  of  criteria  are  appropriate  for  evaluating  understanding  at  any  level. 

My  discussion  of  understanding  b  informal,  focusing  primarily  on  examples  from  human- 
computer  interfaces  to  illustrate  the  various  points.  Cognitive  theories  are  being  developed  that 
more  accurately  specify  the  nature  of  understanding.  The  framework  for  characterizing  under¬ 
standing  used  here  is  based  on  current  theories  of  problem  solving  and  language  understanding. 
Ideally,  analyses  of  user  understanding  will  reach  a  similar  level  of  description,  maximaing  the 
extent  to  which  work  on  human-computer  interfaces  can  benefit  from,  and  contribute  to,  other 
developing  theories. 
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I  view  the  user’s  task  in  interacting  with  a  complex  device  as  a  problem-solving  episode.  The 
user  constantly  sets  goals  and  must  plan  how  to  achieve  these  goals  with  the  available  com¬ 
mands.  This  view  is  generally  consistent  with  several  other  current  analyses  of  human- 
computer  interactions  (e.g..  Card,  Moran.  &  Newell,  1983;  Kieras  &  Poison,  1982;  Moran, 
1983;  Norman,  in  press). 

Figure  1  presents  a  typical  planning  episode  in  the  fonn  of  a  hierarchical  goal  structure,  or 
planning  net  (cf.  VanLehn  &  Brown,  1980;  Saceidoti,  1977).  At  the  higher  leveb  of  the  plan¬ 
ning  net  are  global  goals,  [fere  the  person  is  using  a  text  editor  The  current  goal  is  to  edit  the 
paper.  This,  in  turn,  generates  the  additional  goal  to  "transpose  two  words."  Since  thb  goal  does 
not  correspond  to  an  executable  action,  further  goal  specification  and  planning  is  required. 
"Transpose  two  words"  is  broken  down  into  the  subgoals  "delete  wordl"  and  "insert  word!  after 
word!"  which  correspond  to  the  actions  of  typing  *dw*  (delete  word)  and  "pf  (put),  respectively. 

Planning  does  not  necessarily  stop  with  the  selection  of  the  primary  actions.  Associated  with 
actions  are  requisite  conditions  that  must  be  taken  into  account  in  the  planning  process: 

•  Prerequisites  are  conditions  that  must  be  satisSed  before  an  action  can  be  performed.  The  prere¬ 
quisite  of  *dw'  and  'p*  is  that  the  cursor  be  at  the  appropriate  location.  Additional  goals  must  be 
generated  to  ensure  that  these  prerequisites  are  satisfied. 
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FIGURE  1 

Ptanning  act  for  the  task  Trmipoit  two  words  (from  Riley  *  O'Malley,  1984). 
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•  CoHuquences  are  the  changes  that  result  from  performing  an  action.  In  this  example,  the  conse* 
quence  of  'dw*  is  that  the  word  is  deleted  from  the  text.  The  consequence  of  'p^  is  to  put  the 
most  recently  deleted  word  at  the  location  of  the  cursor.  These  consequences  define  the  onler  in 
which  'dw*  and  ’fT  must  be  executed  and,  furthermore,  place  restrictions  on  interleaving  plans. 

•  Postrequisius,  relevant  to  some  commands,  are  conditions  that  must  be  satisfied  after  performing 
an  action.  For  example,  the  action  of  inserting  text  must  be  followed  by  pressing  the  ESCAPE 
key,  to  return  to  command  mode. 

It  is  one  thing  to  solve  a  problem,  but  quite  another  to  solve  it  with  'understanding.*  As 
Greeno  (1977,  1978)  suggests,*  understanding  depends  on  three  important  criteria  for  evaluat¬ 
ing  the  representation  generated  during  problem  solving: 

Internal  Coherence. 

Are  the  components  of  the  user's  representation  mutually  coherent? 

Validity. 

Does  the  represenution  accurately  reflect  the  behavior  of  the  system? 

Integration. 

To  what  extent  is  the  user’s  representation  integrated  with  the  user’s  knowledge  of  other 
areas? 

Of  course,  devices  can  be  described  at  different  levels.  Devices  can  be  hierarchically  decom¬ 
posed  into  structures  with  each  structure  serving  one  or  more  function  at  a  level  of  the  hierar¬ 
chy  (cf.  Brown,  Burton,  &  de  Kleer.  1983;  Miyake,  in  press).  For  example,  at  one  level  of 
description,  we  can  talk  about  editors,  mail  systems,  and  directories;  at  another  level  we  can 
talk  about  the  underlying  programs,  at  yet  another  level  we  can  talk  about  shuffling  bits.  The 
objects  differ  at  different  levels,  as  do  the  commands  and  procedures  available  for  operating  on 
those  objects.  Thus,  depending  on  the  particular  task  a  user  wishes  to  accomplish,  the  objects 
in  the  user’s  problem  representation  will  differ.  Nevertheless  we  can  use  the  same  criteria  of 
understanding  to  evaluate  a  user's  problem  representation. 

Furthermore,  understanding  continues  to  be  important  regardless  of  the  amount  of  experi¬ 
ence.  True,  skilled  performance  of  routine  tasks  probably  involves  having  a  large  store  of 
automated  procedures  for  accomplishing  frequent  goals,  but  not  all  of  a  user’s  interactions  with 
a  computer  are  routine.  Among  other  things,  users  experiment,  make  mistakes,  and  may  also 
have  to  regenerate  procedures  that  were  once  automated  but  forgotten  through  disuse.  For 
these  reasons,  a  user  needs  to  have  more  knowledge  about  a  system  than  simply  a  list  of  pro¬ 
cedures  for  accomplishing  specific  tasks. 

WHAT  KIND  OF  UNDERSTANDING  DOES  A  USER  NEED? 

In  this  section  I  discuss  in  more  detail  the  three  criteria  for  undentanding  and  their  roles  in 
performance  and  learning. 

Internal  Coherence 

Internal  Coherence  u  the  extent  to  which  components  of  knowledge  are  related  in  an  integrated 
structure.  I  argue  that  a  coherent  knowledge  base  facilitates  learning  and  increases  the  likeli¬ 
hood  that  commands  win  be  remembered  or  can  be  regenerated. 

There  are  many  kinds  of  knowledge  that  contribute  to  internal  coherence: 


‘  Gieeao  used  the  terms  'cobereaoe,*  'coRespoodeuoe,'  sad  *oomctedaess.' 
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•  Knowledge  about  the  action  structure  of  a  command; 

•  Knowledge  about  the  syntactic  structure  of  a  command; 

•  Knowledge  about  how  a  command  works; 

•  Knowledge  about  objects  (e.g.,  61es,  programs,  buffers); 

The  knowledge  of  the  action  structure  of  commands  is  coherent  in  that  goals  are  associated 
with  a  command’s  requisite  conditions  and  component  actions.  Furthermore,  during  planning, 
this  knowledge  can  be  used  to  generate  a  coherent  representation  of  the  hierarchical  relations 
between  related  sequences  of  commands.  In  Figure  1,  there  is  a  central  high-level  goal,  'tran¬ 
spose  two  words,'  and  commands  are  related  to  that  goal  as  either  primary  or  enabling  goals. 

Improved  performance  (i.e.,  increased  flexibility  and  efficiency)  could  be  achieved  by 
memorizing  additional  goal-command  pairs.  But  still,  important  components  of  understanding 
would  be  missing— components  that  could  have  an  important  influence  on  performance  and 
learning.  Improved  understanding  could  be  achieved  with  the  addition  of  knowledge  about  the 
syntactic  structure  of  commands,  as  shown  in  Figure  2. 

In  the  particular  editor  used  in  this  example  (Berkeley  UNIX  vi),  command  sequences  are 
defined  as  the  cross-product  of  an  action  and  a  text  object:  'dw*  is  the  cross-product  of  the 
action 'd'  (for  delete)  and  the  object  'w'  (for  word).  Furthermore,  the  text  object  can  be  pre¬ 
ceded  by  a  number,  e.g.,  'd4w'  deletes  four  words.  Other  rules  involve  systematic  changes  in 
the  scope  or  direction  of  a  command.  Whatever  the  form  of  these  rules,  they  add  coherence  to 
the  knowledge,  facilitating  learning  and  increasing  the  likelihood  that  commands  will  be 
remembered  or  can  be  regenerated. 

Nou  that  the  coherence  of  a  user's  representation  depends  largely  on  the  system 
Use^.  If  there  is  no  high-level  rule  to  describe  the  syntactic  structure  of  a  command 
language,  the  user  is  restriaed  in  forming  a  coherent  representation  cf  the  relation 
between  command  sequences.  Indeed,  several  studies  (Payne  dt  Green,  1983;  Reb- 
ner,  1981)  have  linked  the  degree  <4  syntactic  coherence  to  users'  ability  to  learn, 
remember,  and  regenerate  commands. 


FIGURE  2 

Kflowledge  Sbovt  the  (ynuctie  ftraemre  of  conniadi. 
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Knowledge  about  how  a  command  works  also  adds  internal  coherence  to  the  user’s  representa¬ 
tion  of  the  editor  command  structure.  For  example,  in  Figure  1,  the  consequence  of  deleting  a 
word  is  not  related  directly  to  the  action  of  putting  the  word  in  a  new  location.  That  is,  there  is 
no  explicit  representation  of  the  relation  between  the  consequence  of  'dw*  and  the  prerequisite 
of  'p.*  In  fact,  the  consequence  of  *dw*  is  to  place  the  wori  in  a  temporary  storage  place,  or 
buffer.  The  prerequisite  of  *p'  is  that  there  be  something  in  the  buffer  and  its  consequence  is 
to  put  the  buffer  contents  at  the  location  of  the  cursor.  Figure  3  shows  how  this  additional 
knowledge  adds  coherence  to  the  user’s  representation  by  explicitly  identifying  the  relation 
between  the  consequence  of  'dw*  and  the  prerequisite  of  *p.* 

Other  kinds  of  knowledge  also  contribute  to  coherence.  Most  editors  keep  the  modified  ver¬ 
sion  of  the  text  in  active  memory  and  do  not  update  the  permanent  copy  on  the  user’s  disk 
until  the  user  leaves  the  editor.  In  order  to  understand  this  fact,  the  user  has  to  know  that  the 
editor  is  a  program  and  be  familiar  with  concept  of  memory  and  disk  storage  (see  Kieras  A 
Poison,  1982,  for  further  discussion).  Users  also  need  to  Imow  about  the  properties  of  the 
objects  that  are  operated  on  by  these  programs  and  commands.  A  coherent  representation  of 
why  the  command  to  edit  a  file  is  sometimes  preceeded  by  a  command  to  change  directories 
and/or  a  command  to  change  the  file  protection  depends  upon  the  user  knowing  that  files  are 
organized  in  directories  (which  are  also  files)  and  that  each  file  has  a  protection  stattts  that  is 
checked  by  the  editor  program.  A  coherent  representation  of  the  effects  of  editor  commands 
requires  knowledge  of  how  text  objects  are  specified,  e.g.,  the  different  notions  of  a  'line*  dis¬ 
cussed  by  Owen  (in  press). 

An  interesting  issue  concerns  whether  there  is  a  tradeoff  between  internal  coherence  and 
leamability.  Coming  up  with  a  single  coherent  view  of  a  system  may  involve  structural  models 
and  rules  that  are  quite  difficult  to  learn.  Multii^e  ‘’distributed*  m^els  may  be  less  coherent 
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overall  but  may  be  easier  to  leam  (see  diSessa’s,  in  press,  discussion  of  this  point). 

Another  issue  concerns  whether  knowledge  at  any  level  of  description  increases  coherence. 
Would  an  explanation  of  the  editor  in  elaborate  programming  terms  or  design  terms  increase 
coherence?  Or  would  it  simply  provide  an  alternative  perspective  (see  Miyake,  in  press), 
without  directly  affecting  the  connections  between  the  objects  of  concern?  That  is,  this  addi¬ 
tional  knowledge  about  underlying  mechanisms  and  design  constraints  may  add  more  nodes  and 
links  to  the  knowledge  representation,  but  it  is  not  clear  that  the  density  (i.e.,  coherence)  of 
the  representation  would  increase. 

Several  studies  (e.g.,  Halasz  &  Moran,  1983;  Kieras  &  Bovair,  1984)  show  that  having  some 
model  of  how  a  device  works  facilitates  learning,  retention  and/or  invention  of  procedures  for 
operating  a  device.  However,  the  benefits  of  a  device  model  depend  on  whether  it  allows  the 
user  to  infer  the  exact  steps  required  to  operate  the  device.  Specifically,  inferring  procedures 
requires  information  about  the  system  topology  (what  is  connected  to  what)  and  the  principle 
of  flow  of  control.  Thus  the  critical  *how-it-works'  information  is  the  specific  description  of  the 
controls  and  their  path  relations  to  the  internal  components.  Neither  details  about  the  nature 
of  the  components,  nor  general  principles  about  how  a  system  works  enable  users  to  infer  pro¬ 
cedures.  How-it-works  information  must  be  selected  so  that  it  is  actually  relevant  to  the  user’s 
task — it  must  explain  how  or  why  a  goal  must  be  accomplished. 

Notice  that  this  docs  not  constitute  a  general  argument  against  the  role  of  formal  principles 
in  learning  complex  skills.  In  basic  electronics,  physics  principles  can  be  used  to  constrain  the 
quantities  in  the  problem  representation,  adding  coherence.  Physics  principles  also  provide  a 
way  of  relating  different  procedures,  thereby  embedding  them  in  a  higher-order  organized 
structure  that  could  be  beneficial  for  retention  and  application.  (See  Riley,  1984,  for  a  detailed 
discussion  of  the  role  of  formal  principles  in  learning  basic  electronics.) 

Validity 

Validity  is  the  extent  to  which  the  user’s  components  of  knowledge  are  consistent  with  the 
behavior  of  the  system.  To  the  extent  that  the  user’s  knowledge  corresponds  to  the  system’s 
behavior,  the  user  will  be  able  to  explain  and  predkt  the  effects  of  commands  and  generate  new 
sequences  of  commands  to  achieve  desired  effects.  I  identify  different  kinds  of  validity  that  are 
roughly  equivalent  to  diSessa’s  distinction  between  functional  models,  distributed  models,  and 
structural  models  (diSessa,  in  press). 

Distributed  and  structural  models  correspond  to  how-it-works  knowledge  at  varying  levels  of 
description.  How-it-works  knowledge  enables  users  to  predict  the  behavior  of  any  sequence  of 
commands,  justify  rules  when  they  are  correct,  explain  their  limitations,  and  go  beyond  them. 
However,  as  diScssa  (in  press)  and  Young  (1981,  1983)  point  out,  structural  models  are  not 
always  sufficient  to  enable  fluent  interaction  with  the  system.  A  significant  amount  of  problem 
solving  may  be  required  to  invent  a  way  to  achieve  a  goal.  It  seems  highly  unlikely  that  users 
would  continually  rederive  procedures  through  explicit  reference  to  models  and  rules.  For 
example,  when  transposing  two  letters  for  the  100th  time  it  is  unlikely  that  the  user  explicitly 
represents  the  letter  going  into  the  buffer  and  then  being  moved  from  the  buffer  to  a  new  loca¬ 
tion  in  the  text.  Rather,  the  keystrokes  corresponding  to  this  procedure  are  probably  done 
automatically,  as  a  unit  (cf.  Robertson  &  Black,  1983). 

Note  validity  does  not  depend  on  whether  the  user's  models  are  identical  to  (contain 
same  objects  and  relations  as)  the  Design  Model,  as  long  as  they  lead  to  the  same 
predictions.  At  the  same  time,  jf  correspondence  is  maintained  as  a  user's 
knowledge  encompasses  more  and  more  of  the  system,  the  space  cf  functionally 
equivalent  models  probably  decreases. 

Users  often  generate  context-dependent  vaUdity  to  achieve  coherence  at  the  expense  of  accu¬ 
racy.  Lewis  (in  press)  shows  how  users  generate  coherent  explanations  of  a  command’s  func¬ 
tion  in  a  specific  context  but  these  explanations  often  do  not  predict  the  command’s  function  in 
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another  context  (see  de  Kleer  &  Brown  1983).  Robust  models  contain  no  implicit,  context- 
specific  assumptions  about  a  command's  function.  Such  models  should  predict  the  command’s 
effects  and  functions,  regardless  of  the  particular  command  string  it  is  embedded  in.  Robust 
models  correspond  to  the  behavior  of  the  system  for  sequences  of  commands  that  were  unanti¬ 
cipated  and  therefore  not  precompiled. 

Consider  robustness  in  the  context  of  the  buffer  model.  Knowledge  about  which  commands 
change  the  contents  of  the  buffer  and  which  commands  access  the  contents  of  the  buffer  suf¬ 
fices  to  predict  and  explain  the  effects  of  many  command  sequences.  For  example,  the  com¬ 
mand  for  changing  a  word,  'cw,*  also  has  the  consequence  of  replacing  the  contents  of  the 
buffer  with  the  word  that  was  changed  (and  therefore  deleted).  Following  a  'cw*  event  with 
the  command  'p*  has  the  effect  of  putting  the  changed  word  at  the  current  location  of  the  cur¬ 
sor.  If  'dw*  were  executed  between  'cw*  and  'p,'  the  model  correctly  predicts  that  consequence 
of  'p'  would  be  different. 

An  interesting  issue  concerns  the  degree  of  robustness  acquired  with  experience.  I  use 
diSessa’s  terms  'structural'  and  'distributed'  to  characterize  two  different  perspectives,  de 
Kleer  and  Brown  (1983)  suggest  that  with  experience,  users  acquire  increasingly  robust  device 
knowledge — approaching  what  diSessa  refers  to  as  'structural  models.'  Initial  component  models 
invariably  include  many  implicit  assumptions  about  the  overall  functioning  of  the  device,  which 
may  or  may  not  be  correct.  With  experience,  component  models  become  more  robust  by  mak¬ 
ing  implicit  assumptions  explicit.  This  transition  is  primarily  motivated  by  discovering  viola¬ 
tions  of  consistency,  validity,  and/or  robustness  constraints.  That  is,  the  causal  model  may 
contain  conflicting  models  for  a  single  component  type,  the  causal  model  may  not  correspond 
to  the  observed  behavior  of  the  device,  or  the  causal  model  may  only  correspond  when  the 
device  is  functioning  correctly.  Discoveries  like  these  encourage  the  learner  to  identify  an 
underlying  implicit  assumption  in  a  component  model,  gradually  making  the  component  models 
more  robust.  These  assumptions  (and  future  ones)  need  not  be  discarded — they  lead  to  very 
efficient  reasoning  about  the  correctly  functioning  device  from  which  they  originated.  Thus 
with  experience,  the  learner  probably  stores  mote  and  more  device-specific  assumptions  along 
with  the  component  models.  These  new  component  modeb  are  robust  in  that,  if  assumptions 
are  violated,  the  learner  can  automatically  dbtinguish  these  assumptions  from  the  actual  model 
and  proceed  to  envbion  a  correct  causal  model  of  the  device. 

I  extrapolate  from  diSessa’s  notion  of  dbtributed  models  to  propose  an  alternative  perspec¬ 
tive.  It  b  possible  that  users  continue  to  have  many  modeb  to  account  for  different  aspects  of 
the  system  and  no  single  model  is  robust  (in  the  strong  sense  used  by  de  Kleer  and  Brown). 
Does  an  expert  electrician  ever  acquire  robust  modeb  of  the  circuits  being  tested?  Does  an 
automcchanic  ever  acquire  a  robust  model  of  a  car  engine?  What  about  operators  of  steam 
plants  and  nuclear  power  plants?  Often  there  may  be  no  single  model  that  is  perfect  for 
describing  the  behavior  of  the  system  (cf.  Bott,  1978;  Rumelhart  &  Norman,  1980).  The  dbtri¬ 
buted  perspective  says  that  improvements  in  skill  result  from  learning  to  apply  the  right  model 
at  the  right  time  and  perhaps  refining  modeb  with  context-specific  knowledge. 

It  is  likely  that  the  distributed  view  of  learning  describes  most  users.  For  one  thing,  infer¬ 
ring  a  robust  causal  model  b  difficult,  if  not  impossible,  even  for  relatively  simple  devices  (cf. 
Miyake,  in  press;  Young,  1981).  Young’s  (1981)  account  of  how  he  derived  a  robust  model  of 
the  stack  calculator  shows  the  importance  of  systematically  generating,  testing,  and  revbing 
hypotheses.  In  contrast,  many  users  probably  form  hypotheses  on  the  fly  on  the  basis  of  iso¬ 
lated  examples,  fail  to  experiment  systematically,  or  may  be  afraid  to  experiment  (see  Lewb,  in 
press,  for  further  dbcussion).  Especially  when  a  detailed  model  b  not  required  to  operate  a 
device,  users  probably  do  not  take  the  time  to  generate  one.  One  of  Miyake’s  subjects  had 
used  a  sewing  machine  for  years  without  generating  a  detailed  model  of  how  the  machine 
worked — although  when  forced,  she  generated  and  refined  a  very  robust  model. 

There  are  several  reasons  why  understanding  more  about  the  kinds  cf  modeb  users  generate 
b  interesting  from  a  design  perspective.  Knowing  more  about  the  kinds  of  modeb  people 
develop  with  experienee  would  tell  us  something  about  the  limits  on  the  complexity  of  the 
modeb  with  which  humans  reason — or  at  least  the  kinds  of  modeb  with  which  they  prefer  to 
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SUMMARY 

Understanding  facilitates  learning,  provides  predictive  and  explanatory  power,  increases  the 
likelihood  that  procedures  will  be  remembered  or  can  be  regenerated,  and  enables  the  transfer 
of  skills.  In  unfamiliar  situations,  understanding  improves  the  efficiency,  flexibility,  and  relia¬ 
bility  of  performance,  permits  and  constrains  generation  of  new  procedures,  and  facilitates 
checking  answers. 

A  direct  outcome  of  the  analyses  presented  in  this  charter  is  a  view  of  understanding  as  a 
multi-dimensional  quality  rather  than  as  something  one  has  or  one  does  not  have.  Understand¬ 
ing  is  related  to  three  characteristics  of  the  user's  knowledge:  internal  coherence,  validity,  and 
integration.  Coherence  concerns  the  degree  to  which  the  user's  components  of  knowledge  are 
related  in  an  integrated  structure.  Validity  concerns  the  extent  to  which  the  user's  components 
of  knowledge  accurately  reflect  the  behavior  of  the  system.  Integration  concerns  the  degree  to 
which  the  components  of  knowledge  are  related  to  other  components  of  user's  knowledge. 

The  degree  of  internal  coherence,  validity,  and  integration  does  not  depend  on  a  single 
aspect  of  knowledge,  but  upon  several.  This  emphasizes  that  a  user  should  not  be  considered 
as  either  performing  with  or  without  understanding,  since  it  clearly  is  possible  for  the  user  to 
have  acquired  some  components  of  knowledge  and  not  others. 
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reason.  It  would  also  provide  us  with  information  about  how  multiple  mental  models  are  coor¬ 
dinated  in  learning  and  performance.  Furthermore,  information  alx>ut  how  those  models  are 
acquired,  modiHed,  abandoned,  may  be  useful  in  guiding  users  through  progressive  layers  of 
competency. 

lategratioa 

Integration  is  the  extent  to  which  the  components  of  knowledge  in  one  domain  are  tied  to  other 
components  of  a  person’s  knowledge.  EaU  of  learning  depends  on  the  extent  that  objects  and 
relations  in  a  new  domain  can  be  connected  to  familiar  components  of  knowledge. 

One  kind  of  integration  that  is  especially  important  for  new  usen  is  integration  with  general 
knowledge.  For  example,  many  editor  goals  are  conneaed  with  goals  familiar  to  the  user — 
changing  and  deleting  characters  and  words,  inserting  new  text,  correspond  to  general  goals  in 
editing  text,  regardless  of  whether  the  text  is  handwritten,  typewritten,  or  written  using  a  com¬ 
puter  text  editor. 

However,  the  semantia  of  ike  aaions  are  not  necessarily  the  same.  For  example, 
on  a  typewriter,  the  actions  associated  with  Change- word  involve  erasing  the  old 
word,  making  space  for  the  new  word,  and  then  typing  in  the  new  word.  The  goals 
"Transpose-Two-Letters"  and  "Repeat-Last-CommantT  have  no  direct  counterpart  in 
typewriting  or  handwriting  (but  transpose-two-words  is  used  in  proof-reading;  also, 
these  actions  are  frequently  carried  out  in  several  steps,  e.g.,  with  white-out).  See 
Owen’s  discussion  of  the  same  issue  (in  press). 

A  second  kind  of  integration  is  with  other  knowledge  of  the  other  systems.  Buffers  and 
cross-product  rules  are  not  specific  to  this  particular  text  editor  or  to  text  editors  in  general.  At 
the  right  level  of  description,  these  concepts  can  be  connected  to  other  systems,  leading  to  effi¬ 
cient  transfer  of  knowledge.  For  example,  most  editors  use  buffers  to  store  text  that  has  been 
recently  deleted  or  inserted.  Even  though  editors  may  differ  in  the  specific  ways  they  use 
buffers,  simply  knowing  that  buffers  are  used  constrains  hypotheses,  and  explanations. 

Integration  is  not  necessarily  beneficial.  As  Lewis  points  out  (in  press)  learners  unfamiliar 
with  a  domain  often  make  connections  that  are  not  valid,  resulting  in  inefficient  performance 
and  errors.  ^  Users  learning  to  use  a  text  editor  for  the  first  time  connect  commands  for  insert¬ 
ing  text  to  their  knowledge  of  inserting  text  using  a  typewriter  (or  to  their  knowledge  of  insett¬ 
ing  text  using  paper  and  pencil).  As  a  result,  users  often  think  that  space  has  to  be  made 
before  text  can  be  inserted.  Similarly,  users  think  that  any  text  visible  on  the  screen  is  in  the 
file  and,  vice  versa,  any  text  not  vbible  on  the  screen  is  not  in  the  file.  This  leads  to  predict¬ 
able  confusion  in  editors  where  inserting  text  has  the  consequence  of  typing  over  existing  text 
until  a  special  key  is  pressed  to  terminate  the  input  mode.  Subjects  are  likely  to  think  that  the 
over- typed  text  is  no  longer  in  the  file.  Predictable  confusion  also  results  in  editors  that  leave 
deleted  text  on  the  screen  during  input  mode,  even  though  the  user  has  backspaced  over  the 
text  to  delete  it.  In  this  case  the  user  is  likely  to  think  that  the  text  has  not  been  deleted,  when 
in  fact  it  has  been. 

A  major  problem  with  naive  models  is  that  they  are  surprisingly  persistent  (cf.  Clement, 
1983;  DiSessa,  1983).  Among  the  frequently  suggested  reasons  for  the  persistence  of  these 
naive  models  are  that  (a)  students  may  misinterpret  or  distort  information  to  fit  their  naive 
views;  (b)  students  may  have  several  models  for  different  instances  of  the  same  phenomenon 
and  shift  between  models  to  interpret  the  various  situations;  (c)  students  may  focus  only  on  the 
salient  aspects  of  an  event  and  ignore  less  salient  (or  invisible)  factors.  Clearly,  further  empiri¬ 
cal  and  theoretical  analyses  are  required  to  identify  the  cognitive  processes  that  could  lead  to 
necessary  changes  in  user’s  models. 


2  (cf.  Bor,  1978;  Douglas  A  Moran,  1983;  KaJaaz  A  Mom.  1982;  Lewia  A  Mack,  1982;  Riley  A  DMaDey,  1984; 
Rumelhart  A  Norman,  1980). 
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